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IA So OBJECTIVES AND ORGANIZATION 


EE LAULI TOLERANT COMPUTER SYSTEMS 


In modern applications, exceptionally high reliability 
mayors are often required from digital computers. Examples 
Seewsuch extremely severe requirements can be found in deep 
Space missions and some military applications. In addition 
bong non-critical jobs often require concurrent error 
detection. To achieve those high reliability levels one has 
Mmembable three basic strategies, two of which are also 
Span le of providing concurrent error detection capability: 

ie Use ot hienly reliable components in the manufacture 
computers. This approach leads very rapidly to astronomi- 
Bar cost increases. 

2. Use of redundancy-—- equipment redundancy or sub- 
Systems redundancy. In this scheme fault detection is 
Penmeved by comparison of outputs, and error correction 
meeough some majority voting criterion. 

Meese Ot more Sophisticated redundancy schemes, such 
encoding for error detection and/or correction. 

The term fault tolerancy applies to those redundancy 
Schemes designed to provide reliable operation in systems 
constructed with relatively unreliable components. The most 
emae accepted concept for fault tolerant computing system 
Mrebres the existence of a built-in capability to preserve 
Biemcontinued correct execution of programs and input-output 
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functions even in the presence of a certain set of operational 
AMS AO our purposes an operational fault is a change of 
the value of one or more logical variables occurring as a con- 
sequence of a failure in the system's hardware. 

Iheseszstematic study of fault tolerant systems was initi- 
ated in the early sixties, and has as one of its milestones 
the publication by William Pierce of his book, Failure Tolerant 
Meutter Design. In this work, inspired by the results of 
Information Theory and Coding Theory, he attempted to apply 
the idea of redundancy to achieve high reliability in computer 
hardware. 

ime field of fault tolerance has grown significantly Since and 
unifies various approaches to reliability assurance by means 
of testing, diagnosis and redundancy in machine organization 
and operation. It emerged in the late 1960's and reached 
Maturity with the formation of the IEEE Computer Society 
Technical Committee on Fault-Tolerant Computing in 1969 and 
meme subsequent holding of the First International Symposium 
on Fault-Tolerant Computing in 1971. This Symposium that has 
seen held annually since, has became the major international 
forum for the discussion of current experience and new ideas 
in system design, redundancy techniques, system modeling and 
analysis, testing and diagnosis methods, and other related 


areas. 


E ORMULATION OF THE THESIS OBJECTIVE 


eoo e tiye of this thesis is to study the theoretical 
fundamentals behind the fault tolerant design of arithmetic 
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units. More specifically this study will be concerned with 
Mie so-called arithmetic error correcting codes. 

Parity @€feck error Correcting codes have been extensively 
used in communications to ensure reliability in communica- 
tions flowing through noisy channels. In a similar manner 
Mose codes are suitable for use in computer systems whenever 
transmission of information takes place between different sub- 
Mates, to prevent error caused by failures in the circuitry 
imvoilved. In addition, they may be used to provide the 
desired degree of fault tolerancy to memories of different 
pes. Similarly, error correcting codes can be designed that 
Will be conserved through arithmetic operations. An arithmetic 
code is a code such that, given a set of arithmetic operations, 
the result of those operations performed on operands represented 
mm@eencoded form is the encoded result of the operation if 
performed in the original operands. 

One should notice that in studying fault tolerance as 
achieved by the use of error correcting codes we often assume 
Mmplacitiy perfect, error free, decoding. It is interesting 
memcomment that this assumption is, in the context of fault 
erant computer systems, stronger than when concerning 
Bor correcting codes in communications. In fact, the 
M king Circuitry in fault tolerant computers is essentially 
the same kind of hardware used in the units to be checked, 
while in communications one can easily justify the belief 
that the decoder hardware is much more reliable than the 


noisy channel. 
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Eee coeniz ino this tact we will, through all discussion 
in this thesis, assume perfect decoding, unless otherwise 
Marea simee our maın objective is to study the structure 
the codes, as opposed to the evaluation of the resulting 
reliability improvement obtained when those codes are used 


iemtault tolerant computers. 


Meee ORGANIZATION OF THE THESIS 


The theory of the parity check error correcting codes used 
iiecommunications has as one of its basic ideas the concept of 
distance between two code words. In very simple terms the 
distance between two code words, or in general, between two 


b TD 


n-tuples a,_1> 87.7» +++,» dj -..aja and b a 


1 1o wl 
...b,b, is the number of positions such that a; + bs. Ifa 
code word w is transmitted and Wa is received, we say that 


3 


k errors have occurred if the distance between w and Wo 
d(w,w,) = k va RR: 


As mentioned before, the objective of our study--arithmetic 

codes-- is codes that are preserved throughout a set of 

memunmetic Operations, in particular addition, since this 

Me basic operation performed by computer arithmetic units. 
It should be clear that the definition of distance and 

Mi resulting classification of errors as described above 

not adequate as the basis for a theory in arithmetic 

codes. In effect, even if the adder cell is designed in 

such a way that a single hardware failure affects only one of 


m results or the carry bit, a single failure may result in 
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ee modification Of the value of many code elements at the 
der output, due to the propagation of the carry. A 
different concept of distance suitable for use in the theory 
Meearithmecic codes is presented and developed in Chapter Il. 

We will discuss in this work two general classes of 
arithmetic codes: AN codes and separate codes. AN codes, 
at are discussed in Chapters III and IV, feature some in- 
convenient attributes as far as practical implementation is 
@emecrned. One such inconvenience is that the original 
Moi mation elements are not preserved in the encoded form. 
In addition, medium distance codes with large numbers of 
code words have not been found. Nevertheless, they are very 
wa ante ın Many respects, particularly from a theoretical 
Peale Of view, Some important classes of AN codes are in 
some respect analogous to some classes of algebraic codes. 
Mites basic theory of AN codes is studied in Chapter IV. In 
M@iepter V a special class of codes analog to the cyclic 
algebraic codes is introduced and discussed. 

orante codes are those which preserve in the encoded 
form the original representation of the encoded information, 
concatenated with a set of check symbols. Those codes which 
Meesmore attractive to practical implementation are introduced 
and discussed in Chapter V,where their relation with associated 
AN codes with the same error correcting and detecting capa- 
Dility is explored. Even though this thesis is mostly 
concerned with the theory of arithmetic codes, a brief dis- 
ee sion on implementation is carried out in Chapter VI. 
Finally, some conclusive comments as well as some topics open 


ror future research are briefly presented in Chapter VII. 


E: 





EN RILEMETTCZDISTÄNGCE 


A. ERRORS IN BINARY ADDITION 


It is very important in the design of any error 
Memrecting Code to take as a preliminary step the identifi- 
won of the most likely modes of failure in the coded 
System. 

ios ne aton will provide the starting point for 
Mie tcormulation of a convenient description of the error that 
mammbe present at the system's output. 

ISS Seto three questions will be examined in 
@etatl for a binary adder, a unit which performs addition 
on two integers represented as binary numbers. At this 
Bemcicular point we will not impose any restrictions on 
those integers other than the requirement of being non- 
Motivo. The adder, in this fashion, may be a potentially 
eeni te device, Since no limitation has been imposed with 
mespect to the size of the operands. 


The radix-2 form of an integer I is the expression 


a 1 2 T 
I a, + &- en a)» a N a,.2 + 
a, € COSI Cal) 
When aj = A and A 7 0, we usually write the 


radix-2 form as the n-tuple 


a 


n=) n=2° eee i es 28 o ae = 





Sl 
(a) block diagram 


een 


(e 
EXE 
ae | 


(db) logic diagram 





(c) truth table 


IZ LO. Full Adder. Single component failure will not 
cause C; and vs be in error simultaneously. 
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Maier say chat n places are required to represent I in 
Badıx-2 farm. 

Mec tery can be thought of as a sequence of 
elemental building blocks--full adders in integrated circuit 
terminology--that are associated with each binary position 
AO wer ot 2, The elemental adder has as inputs the co- 
See ents or the two operands, corresponding to a given 
weon an their radix 2? forms and the carry propagating 
Mmeemetiec previous position. It generates at its output the 
Nespective coefficient of the radix-2 form of the result and 
Mimtemeatry to the next binary position. An adder cell is 
merecesented in Figure 2.1. 

e a a Con illustrated in Figure 2.l-it seems 
wa to consider that a single error has occurred 
whenever an incorrect sum r; Or an PnC OTrect carry Ci is 
wead in consequence of this concept a single error 
Be zadder output will correspond to the addition of +22 
Mae correct result of its operation. 

pUppose now that the actual result produced by a binary 
Bader differs by E from the correct result. E can be 


An resented as 


EAS 


Ope 
ho 
H 
(D 
H 
N 
Zn 
Ra 
œ 
+ 
pa 
A 


INES then natural to consider that the number of errors 
occurred--the arithmetic weight of E--as being theminimum 
number of e; for which e; 7 0 in an expression such as (2.2). 


Bor example, E = 7 
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wer 1x2’ - ix? 


w(7) = 2 


Pee ARITHMETIC WEIGHT 


fiemronrmalize the concept introduced in the previous 
Section, let us consider an error E, which may be positive, 


Maive on zero. We can express E as 
e e e a.. e,27 a 
SE A O, (2.5) 


pm@en an expression is called a modified binary form for E, 
Amin general is not unique as illustrated in the example 
in Section II.A. It can be easily seen from (2.5) that if 


2+ divides E then e, Ze er = 0. 


Romer te LOms2 . | 

(tCmmMiumictlemvchOnt Or the integer E, denoted W(E), 
m least number of nonzero coefficients in a modified 
Mmary form for E. Besides the fact that an expression of 
mien rOrm given in (2.3) is not unique in general, it is 
meesible that more than one of those expressions have the 


minimum number of nonzero terms. 


F Z 2 I E 2 0 
Baer 1 x 2 = | x 2° - 1x Zz 


and thus, the weight of 3 is 2, but there are two different 
expressions that achieve the minimum of two nonzero terms. 
There is, however, a canonical form for every number which 


has the minimum number of terms. This form, introduced by 
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Reitwiesner, is unique and has proved of much importance in 
Maewtheory Of arithmetic coding. It is called the non- 
mapiacent torm (or NAF for short) if the coefficients e; 


satisfy e.e. DD 2, In other words, if 


Il 
there are no two adjacent nonzero coefficients in its ex- 


pression. 
Theorem 2.1 


For every number N there is a unique representation 


Sa the form 


EN 
in which ©; 


+] or 0, and in which no two successive =, are 
both nonzero. This representation has the minimum number of 


nonzero terms. 
Proof 


First, the existence of a representation of this 
type with a minimum number of nonzero terms will be demon- 


strated, and then the uniqueness will be demonstrated. Let 
= piers 
E e 2 E HA 


If there exists two successive nonzero Ej then let the pair 


. . al! a = 7 
with the smallest i be ei ? + ej, A E e; Si+1> 
a i ; | 
then Si+] ea Ze e; 2" = Si+1] 2* and the resulting expression 
has fewer ones. If See then 
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1... 2! ey 


ST i ¡+1 i 


Mmemints substitution is made in Equation 2.4, the coefficient 


OL git will become zero. The term ran gire can be combined 


i 


giré TE Ex +2 1s zero, the new 


with the existing term C49 : i 


expression has the same number of terms as the old. If 


e, = -©. ,, these terms cancel and there are fewer terms. 
IF? Te 
If ee €; 4, then combined they become 
ioe 2 ae 775 
+ e. MEN 
eee Z ZAT 2 en 2 
i? 


TE: : 1+5 
and the coefficient of 2 becomes zero, while the e. a 


1+1 
1+3 
2 F 


must be combined with the term e. 5 The "carry" may 


IF 
propagate to the highest-order term, but each time a carry 
occurs, the number of nonzero terms decreases. Thus, the 
resulting expression has the same general form given by 
Equation 2.4, and has no more nonzero terms than the original 
expression, and has no two successive nonzero terms of degree 
mess than itd. 

If this process is repeated, an expression will result 
that has no two successive nonzero terms, and no more nonzero 
Mees than the original expression. The process will certainly 
terminate because each step leaves at least two more terms in 
the low-order part which has no pair of successive nonzero 
terms, and there is at each step no more terms in all than the 
initial number, which was certainly finite. 


If the original expression used had a minimum number 


of terms, the number of terms can decrease no more, and so 
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the final expression must have exactly the same number of 
terms. Since every number certainly has an expression of 
MS orm im Equation 2.3 with a minimum number of terms, it 
follows that every number has an expression of that same 
moe With a minimum number of terms and no two successive 
menzero terms. 

folic romeo chown nehat the expression is unique. 
BEE note that in an expression of the type in Equation 2.3 
maar! COCttICremts tl Or 0, if the leading coefficient is 
+1, then the smallest value of E could occur if all other 


coefficients are -1, and in that case 


E A A 27 = 3 


Rear iv, if tne leading coefficient 1s -1, the largest 
mene E could have would be -1. Thus, an expression can be 
meets and Only if all coefficients are zero. 


Now define 


and suppose that no two successive coefficients in either 
Session are nonzero, and that for at least one i, a; F b: 


Then 


E = f ll 
E Es KO a,-1) 2 O 


2 1 n-2 n-2 


A a 


0 0? : 


1) 





Then, if a; F b., there are two cases; either a. = o or 


one of them is zero. In the latter case, the expression for 

E, = Es Nas a nonzero term (b; 2 a.) pe. Since a carry from 

Maem i-1)ch position is impossible. In the former case the 
1 b )1+1 


term 2b; 2° = i results. But since neither the 


expression for E, or for E, has a pair of successive nonzero 


el 


i : i 
terms, b a = 0, the term b. 2 remains in the ex- 


irl 1+1 


pression for E, - Ey + RA eS O terms a; u and b; ye 
Maemeconbined im this manner, the resulting expression has 
Mi com in Equation 2.3. Not all coefficients are 0, and 
therefore, Es - E, F 0, so that two distinct expressions give 
unequal numbers. 

This proof shows how to express any number in the 
canonical form and thus determine the arithmetic weight. As 


an example, let us take 451 or, in binary notation 


O 1 0 1 1 1 1. 


431 = Pee a etme ee 2 et 2 a a 
= ar De A 1 
> 0 1 
er 2 + lO + 0-1 


and the arithmetic weight is 4, since there are 4 nonzero 
terms in the final expression. 
The arithmetic weights of the first few numbers is 


as follows: 


SO SO IZ 1sS 14 15 16 17 


Hs 
pa 
N 


SS 2 2 1 2 


had i 





I 2582425 20 27 28 29 30 31 32 


O oe 2 3 2 2 


The following pattern was first observed by Chiang and Reed 
MIS70). Starting from any number De pe co E gt 
the weights are just one greater than the weights of 1 through 


nee | Tel alt 


2 starting from Dae Penance come son) te. Z ee 
weights are the same as for the la numbers 2* + za ie 
eee 2+ | 2 ae 


An alternative, and somewhat easier way of computing 
NENA is provided by the following theorem, due to Chiang 


and Tsao-Wu: 
Theorem 2.2 


A ooo n-1? 


Bere 2 forms Of the positive integers 3E and E respectively; 


Let b bo and a .., dq, Ay be the 


Men, the coefficients e; defined by 


il 
ES 
v 
HP 
w 
w 
> 
l 
IN 


SZ Ds 4 ee 


V 

e; 
l 

pa 


Su) POLRI 


ae the coefficients in the NAF for E. 
Proof 


t oten arst that SE and E are both even or both odd, 


hat b. = a 


O O° Hence, 


2] 





no l n-2 
1 e B 1 
É e2 = (be a;,])2 
mol 
Sy eee (bs a). 

a ee 


1/2 (3E-E) = E 


Sor that the e, are eerta nly them oerficients in a modified 


eny form for E and it remains to show that this form is 


momadiacent, i.e., that o ls Ov iommall i. TE da 0 

Mere is nothing to show. Suppose then that e, = -l, ea; 

nat D. Mana a- = 1. We next note that we can obtain 
et] TRI 


Mne the radix-2 forms for E and 2E, the latter being 
just an-2» Ag» 0. Hence, the coefficients in the radix-2 


monm of 3E are given by 


Dead Sea ee (mod 2) 


where Ci ee arry Dt from the addition which gave b.. 


emoy hypothesis, b. 


T 0 and a4, 7 1, so that we must 


i) 
have 


ge Gee modz]: 


NAS. two of the bits being added to give b. ust be mones! 


ill 
Semenat the next carry Ci4, = 1. But pes 
o Sp mod 2) 
ee 
so th É = : - 2 = i P = 
at 8541 Dia ai}? O and hence ej 8-1 0, as was 
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to be shown. An entirely similar argument holds for e, = le 
simple terms Theorem 2.2 shows that the NAF of a positive 
integer can be determined by the bit by bit radix-2 sub- 
[ection or 3E and E. Clearly, if E is negative the NAF of 
E can be obtained by first evaluating the NAF of -E and then 
Beemcing the sign of its coefficients. 

Let's introduce the convenient notation that, in a 
NAF en-1° En-2 °°" e) ... € Aisa In the jth positron 


indicates the coefficient E E O example 


mblbastrates the procedure. 


Ex E=- 125 -E = 125 
3 x 125 = 375 1911301 
leas MATO 

NAF for 125 10000101 

NAF for -125 10000101 


Ban immediate consequence of Theorem 2.2 we have the following. 
Corollary 2.1 


The number of places required for the NAF of E (E a 
positive integer) is one less than the number of places 
memmared for the radix-2 form of 3E. In particular, the number 
of places required for the NAF of E is at most one greater than 


Eieemumber of places required for the radix-2 form of E. 


C. ALGORITHM TO COMPUTE NAF AND ARITHMETIC WEIGHT 


Theorem 2.2 suggests a very simple and convenient algorithm 


to compute the NAF at a given number, and consequently to 


mN 
OA 





determine its arithmetic weight, with the assistance of a 


ei tal computer. 


AO AM e 


k? 
SEDA UA et avy? ttt ayo ag, be the radix-2 form 
for a positive integer E such that a _, = a _, = 0. Set i=0 
and Cp = 0. 


cn calculate in order 


. = ; . i 2 

Di+1 aA. + a, + ec, mode) 
re bit from the above addition 
ae 

ep bf w= pm-2, stop. Otherwise, increase i 


Moet and return to step (1). When the calculaton has 
Seopped, C122? 1112 Ss €p Isa tnerdesıreg NAF for E. 

Very often we are interested in computing only the 
merenmetic weight of a number E, W(E). The following algorithm, 
eue to Garcia, is directly inferable from algorithm 2.1 and 
NES the direct calculation of W(E) from the radix-2 form 
fee, without the computation of its NAF. 


Algorithm 2:2 


ia 
Step (1). Let lap s.. 875 ay J be the radix-2 
enm for a positive integer E such that a = a = 0. 
= ml i 2 
Set 1 = 0, W = 0, and a 0% 
E Ss cop. Otherwise, increase i 


panda go to step (1). When the calculation has stopped, 


W = W(E). 





It should be mentioned that Chiang and Reed have 
given an algorithm for calculating W(E) that does not require 
Iradix=2 form for E as a starting point but works directly 
with integers. Also, Goto and Fukumura and Chien et al. 

have given algorithms for the computation of the NAF of 


E based upon nonrestoring binary division. 


ARITHMETIC DISTANCE 


Mhe theory of error correcting codes the concept of 
Hamming distance, the Hamming weight, W(C, + C5) where Cy and 
C, are two code words, is shown to be a true metric of the 
code space. 


In the theory of arithmetic codes we also recognize that 


the arithmetic weight satisfies the following properties of 
€ 


enorm. 
W(E) = W(-E) 12,5) 
MU to requaltty iri and only if E = 0 RO) 
E EO WE) = W(E') BZ) 


Bererties 2.5 and 2.6 follow directiy from definition 2.] 
memearithmetic weight. Property 2.7 is proved by noting that 
meme NAE'S of E and E' are added digit-by-digit, then carries 
can flow only into the adjacent terms where the digit-by-digit 
Piers Zero, hence E + E' can certainly be written as a 
modified binary form (which may not be an NAF) with at most 

aS many nonzero terms as the sum of the number of nonzero 


Ems in the two NAF's being added. But W(E + E') is the 
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least number of terms in any modified binary form for E + E', 
that 2.7 follows. 
Me o pertres (22) through (2.7) of arithmetic 
MM guarantee that a true metric for the set of integers 
can be defined as follows. 
Definition. 2.2 
Poe aane Ce distance between thegintegers I, and L,, 


denoted D(I,, TO is the arithmetic weight of their difference, 


me., 
D(I,, 1,) = W(I, - 1,) (2.8) 
It is readily checked that for any integers L,, I, and 
I the following three properties which formally define a 


5? 


metric, are satisfied by arithmetic distance: 


D(I,, 1,) = D(I,, I) (29) 
D(I,, 1,) EE quality af and only if 

I, - I, mer) 
D(I,, 1,) = D(I,, Iz) + D(I,, 1,) Bas) 


The above properties which are called the symmetry, positive- 
definite, and triangle-inequality properties, follow directly 
meome (2.5), (2.6) and (2.7) respectively. 

AS a consequence of (2.9) through (2.11), any set of 
integers with arithmetic distance taken as the measure of 
ea tance" forms a true metric space. This fact plays an 
important role in the study of codes for the correction of 


QoS in integer addition. 
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ESA E inpeser char the correct result ot some 
Me ration 1s the integer J but the actual result 1s 1 = J + E, 


mere E is an error with W(E) = i. It follows from (2.8) that 
DOFT JFS i 


î.e., that an error of weight i in some result causes the 
eao neous result to be at arithmetic distance i from the 


true result. 


EERROR IN COMPUTER ARITHMETIC 


In previous sections we have concluded that arithmetic 
Brecht provides a good criteria to measure error in ordinary 
Auron of integers. However, ordinary arithmetic is not 
Mer-aein digital computers. Those in fact perform module m 
arithmetic, with m usually either 2% or 2"-1. The corre- 
sponding arithmetics are respectively known as two's complement 
Meeeimetic and one's complement arithmetic. In Chapter III 
miese arithmetics will be considered in greater detail, but 
ENS point it seems useful to analyze the carry propagation 
in modulo addition. Our objective is to learn what happens 
when an error is made in the carry from the highest, left- 
wadding position to conclude under which conditions, if 
any, such an error will show up in the result as a single 
Error, when measured by the arithmetic weight. 

Pwoultaple Way Of analyzing the carry propagation from 
Biemargnest adding position, supposing that the adder has n 
adding cells ea pk aim poo is to consider the result 
Or the operation Dee 182 oT As). 
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RESTO Ereure 2.2, where a n cell adder is repre- 


n-1 n-1 
€ 
n-1 n-1 
-l 





Ea Binary Adder Block Diagram. 


Mmenwaquestion we are addressing is how to connect C For 


n n 
m = 2; m = eo EA ERer than. por 2 =l. 


Mom ompmececcad this analysis for the three cases above. 


Case 1 - m = 2” 

E AA 000 
+ AAA 000 
A 000 


this case the carry is irrelevant as far as the arithmetic 


1s concerned. 





ss - - - — 0 
: : : n 
Zier carry Propagation form = 2. 
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Case 2 m= 2 

A o a 000 

1 000 

a 000 
u TOR CT 

Mos 001 


The carry propagates to the least significant position only. 
An error in the carry will therefore show up as a unitary 


erkennt error. 





a e copacation Tor m = ae 


iS 


no. 


For these two cases we see that the arithmetic weisht of any 
o: has the same significance as it has for the ordinary 
addition of integers, namely that t failures in the elemental 
Megas units (each failure being an incorrect modulo-two sum 
MA incorrect carry bit) still creates an error E of arith- 
Metic weight at most t in the sum. This follows from the fact 
that the carry bit generated by any elemental adding unit 
flows to at most one other unit. Thus, the arithmetic weight 
Of an error is still an appropriate measure of the amount of 
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Mos tcal mantunction in the adder just as it was for the 
mecinary addition Of integers in radix-2 form. It should be 
eame d out or course that if, in an elemental adding unit, 
the logic which performs the modulo-two addition is shared 
Meee that which generates the carry bit, then a single logical 
wa unction can create an error Of arithmetic weight two. This 
memark applies to the ordinary addition of integers as well as 
the modulo m addition for m = AS or m = 2”. 
Case 3 
APPS emon Tor illustration that m is for example 13. 
Four binary positions are required in the adder so 
1000 
1000 


10000 


EMILO] il) 





0011 


ES lows that an error in the carry from the left most 





Alain unit results in an error of arithmetic weight W(E) = 2. 
e "s ----- ei 





IAS IEEE ORI OE AN CODES 


An AN code generated by a positive integer A is the set 
Maeimcegers AN for 0 < N< B. From the definition above, it 
Ee parent that B is the number of integers in the code. 

The integers belonging to an AN code will be referred to 
Berne Code points. So the code point AN; AO UE ade 
Mood as the encoded version of the information integer Ni + 


Since 


AN, + AN 


1 AA ER 


2) 


Bu ordinary sum of the code points N, and N, is the code 


1 


PERE corresponding to the integer Nee N,, provided 


N, +N 


1 < B SAL) 


2 


In this restricted sense AN codes are linear, and are some- 
m aed linear residue codes. The restriction imposed 


Mene linearity of AN codes is that expressed in (3.1). 


Pee MINIMUM ARITHMETIC DISTANCE AND ERROR CORRECTION 


Befinition 3.1 
The minimum arithmetic distance Dan of a AN code is the 
Moa Of arithmetic distances between all pairs of distinct 


Meee points. The linearity of AN codes leads to the property 


given in the theorem below. 





Theorem 3.1 
The minimum arithmetic distance en of an AN code is 


equal to the minimum arithmetic weight Mu ers a len = 


zero code points in the code 


DAN = min WAN) ORs 


Proof 


ee AN, and AN, are code points with Ny > N5> then 


D(AN,, AN,) = W[A(N,-N,)] = W(AN3) 


where 0 < Nz = Ny - N, < B, which shows that the distance 
between any pair of distinct code points is always the weight 
of some nonzero code point. Conversely, if AN, LS any non 


Zero point, then ‘ 
DEO; AN3) = W(AN,) 


SO that the weight of every nonzero code point is also the 
distance between some pair of distinct code points and 
therefore the theorem is proved. 

The minimum arithmetic distance of an AN code determines 
Mess capability to correct and detect errors in its code 
points. We next establish this relation. 

In the discussion to follow we assume that the correct 
meomlt of some operation is some code point in the AN code 
Aena t any code point is a possible result. For example, 
m operation might be addition (without overflow) of code 


waits. If the correct result is AN; but the actual result 





[we ANT E we will say that an error E has occurred, and 
Mal E the actual error. 

The decoder, which is the device which does the actual 
Bor correction or detection, can operate only on the actual 
Mesule, I. The basic theorem which governs the error correct- 
wand detecting capability of an AN code is as follows. 

Theorem 3.2 

n ee 0 and any s > 0, an AN code can correct all 
ADOS of weight t or less in its code points and can detect 
Mother errors of weight t + s or less in its code points 


Mania only if its minimum arithmetic distance satisfies 


Er oof 
Buppose that Din e e a ne Show that the decoder 
g 


which decodes the result I into the nearest code point AN, 


Mere 1s a code point AN, wN DT, AN- ) e andy anmeunceee 

a detected error if t < D(I, AN, ) ome EO mica tne 7c laamed 
rec tion and detection. For, suppose I = AN + E, where AN 
Ie correct result and W(E) < t, then, D(I, AN) < t. But 

Or any other code point AN', we have by the triangle inequality 
feeeb (1, AN!) > D(AN, AN') - D(I, AN) > t + s, so that Ny = N 
Mene error is corrected as claimed. Similarly, if 

INE) < t + s, then for any other code point AN', D(I, AN') > t 
Maat no code point within distance t of I exists and a 

detected error will be announced as claimed. 


Monversely, suppose that Iran en, there exist 


feoramct code points AN and AN' such that D(AN, AN') < 2t + s. 
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METAN = AN’ = E' - E, where E' is the sum of the t highest- 
order terms in the NAF of AN - AN' and -E is the sum of the 
remaining terms. Hence, W(E') < t and W(E) < t + s. Now, if 


the actual result is 
I = AN + E = AN' + E! 


a decoder to perform the claimed correction and detection would 
be inconsistently required to correct E' and also to correct 
we ect E. Hence, a decoder to perform the claimed correction 
and detection does not exist, and the theorem is proved. 

Ace our Interest im this chapter is the correction of 
errors in computer arithmetic, we shall not further consider 


we odes for correcting errors in unrestricted integer arithmetic. 


E ARITHMETIC MODULO m 


It has been pointed out in Chapter II that most digital 
Computers perform modulo m arithmetic, where m is either 2” 
(two's complement arithmetic) or 2%-1 (one complement arithmetic). 
For any positive integer m, the residue of an integer I, 
modulo m is defined to be the remainder resulting from the 
division of I by m, and will be denoted hereafter as AE 
In other words, RaT) e enn therrange 
OS R (I) < m such that I - R_(1) is a multiple of m. For 
example, R- (235) = R-(-5) = 2. For our purposes, the two most 


important properties of residues are 





aCe) =R [cm + R,(1,) + com + R, (15) J 


Ro, [cy + c,)m + R(T) 


| + 


IN 


EAS + 2.1 (3.2) 
Similarly 


De I,) = Ro, {leq r Rec) [cm + Ra (121) 


i 


Ro, [R(1,)- R, (15) J (Sa) 


Maose properties say in essence that if only the residue of the 
final result is of interest, then the residues of all inter- 
mediate results can be taken without changing the final result. 
The set of integers Z| = torn a mino der 
modulo m addition, which we denote by ©, and modulo m multi- 
aeration, thereafter denoted by &). 


So, I, i I, = Del (+) 15) Sere AE Ene Sum and 
IRA SL) oe 


Meche ring multiplication. The ring above identified is 
mesed the ring of integers modulo m, and the ring operations 
are arithmetic operations modulo m. 

In a digital computer the arithmetic unit performs arith- 
metic modulo m, and the actual results of such operations are 
also integers in Zn Moreover, if the number of code points 
Meme it is convenient to choose m = AB. Then, if AN, and 
AN, are any code points, and hence necessarily integers in 
7 


al 


m? We have 
AN, (JAN, = RaplAN, + AN3] = ARQ(N, + N,) 
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amd Since 0 < Rp (Ny + N3) eoll ows that the modulo m 
iio any twoecode points is another code point. Thus, an 
AN-code is truly linear for modulo m addition. The set of 
code points is closed under addition modulo m and thus the 
Bode is a group; besides, the modulo m product of a code 
point with any integer in Zn is another code point so that 
Mie code is in fact an ideal in Z n’ 

If the code point AN is the correct result of some 
operation in Ze Duet hema cudi result is I, we define the 
ring error F as the unique element of Z Such that I = ANO E, 
or equivalently, F = I@AN. Note that the actual error E is 
@eeeamed as I = AN + E so that the actual error E is either F 
NS depending on whether E > 0 or E < 0, respectively. 
Note also that the actual error may not be an integer in In 

The syndrome S(I) associated with the possibly erroneous 
result I = ANG@)F is defined to be the residue of I modulo A, 
Bnessenerator of the code, i.e., S(I) = RAKTI: Since m = AB, 


we have 
SU OS R, (AN © F) NTE) Coy) 


and we see that the syndrome depends only on the ring error 
which has occurred, and we commonly speak of Ri (E) as the 
eym@arome of the ring error F. The importance of the syndrome 
is that it uniquely identifies which ring errors are consistent 
Busen the result I. 

Lemma 3.1 

For any I in a the set of integers F in 2 1 such that 


I = AN © F Oe ome caede point AN is the set of ring errors 
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Miss mdmnome 1s S(1). This set is the set of ring errors 
Bonsistent wıth 1 and contains precisely B distinct ring 
ESTO TS. 

Proof 


Mhespessible ring errors are the distinct En sueha that 
DA ODE, E 


so there are precisely B such ring errors. Moreover S(I) = 
R, (Ai E ER) = Ba > S(F;) ier SANO errors. 
Ber different possible values for S(I) together with the B 
Mme crrors aS given above with the syndrome S(1) account for 
een = AB ring errors in Zn SOS IES ES ENS 
Ps given above can have the same syndrome S(I). 

nccdlino for arithmetic in L? one moe nera ly firstzpeei-> 
mes a set a One ana WN Ca one desires to correct: 
Beate 1S, for an error F in = and a result such that 
PD = AN @F, one wishes the decoder to correct the result I to 
meomerue value AN. In practice, one would always assign F = 0 
tO l since one would certainly wish the decoder to pass 
w ect results unchanged to the user, but this assumption is 
Bermsnecessary in the following theory. Similarly, one generally 
w tiles another set Ta of ring errors (which may be the empty 
fee) disjoint from Tr: which one desires to detect. That is, 
Ban error F in T, and a result I such that I = AN È F, one 
wishes the decoder to announce a detected but uncorrectable 
error. The following theorem gives the necessary and suffi- 
cient conditions for determining whether such error correction 


and detection is possible for a given AN-code. 
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Ineorem 3.3 

Let To and Ta be any disjoint subsets of Za Men an 
AN-code (with m = AB) can correct all ring errors in We in 
[es code points and can detect all ring errors in je nee es 
meecoe points if and only if there is no ring error Es in me 
which has the same syndrome as some other ring error F, in 
eather De Or TG: 

Mane ds tinetness condition on the Syndromes holds, 
and if T =- ANG F for some F in Tes enen Lemna 5. impies 
Mie moO other error F* in a or = pos sole sostnat I can 
be unambiguously decoded to AN or a detected error unambiguously 
mamounced if there is no such F in I Conversely, ier Bene 
BER ametness condition does not hold, i.e., if S(F,) - S(F,) 
for some Es in Ir ans o meno Ene LT F3 in na or Ty, then by 
Lemma 3.1 both Es and E, e DECRE rors or the resulte 
I = Es and hence a decoder would be inconsistently required 
Meco rrect Es and to correct or detect F3. 

Move Droot ton Theorem 3.5 indicates a possible pro- 
meme for correcting error in modulo m addition with AN 
B@ea Operands. First, one could compute the syndrome S(I) 
wom the actual result I, and then, if an error Fin In has 
Beceurred, to look up its value in a table of syndromes for 
@iemring errors in I A detected error is announced if S(I) 
does not appear in the table. After F has been found, the 
Rue is corrected to the value IOF. If the actual 


Meet Of an arithmetic operation is 


I = AN +E =AN@E 





AN aten con Ens tem tner F ift E> 0, or F -nif E< 0. 
Memeonscaquence the arithmetic weight of the actual error is 
either W(F) or W( -F) since W(F-m) = W(m-F). W(E) has been 
previously shown to be an appropriate measure of the adder 
malfunction for modulo m addition with m = 2”-1 or m = 2”. 
We study next a way of measuring ring error which was proposed 
by Ras and Garcia. 

merinition 3.2 

The modular weight of an integer F thereafter denoted WCF) 
the minimum between W(F) and W( -F). It is apparent from 


Wie above definition that 
ES) WTF). 
m easily verified that the modular weight, for any m, 


stes two of the three norm properties, namely 


WCF) = w CF) (3.6) 


and 


W (E) 


|v 


O ouae no lding only If F= 0. O 


Me triangle inequality 
IEC SE) w (3.8) 


does not hold, however, for arbitrary m. Nevertheless, it 
e@esenold for the cases of greatest interest, namely 
Da os DA as we will show in the follow- 
mmemeneorem due to Garcia. The proof of this theorem is 


Memeeny and tedious. But in face of its importance a complete 
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Roo Will be presented for the case of m = This proof 
meves Some Insight into why the triangle inequality fails for 
arbitrary m, and may easily be changed for the cases where 
oma oer ll. 

Theorem 3.4 

For any integers Es and F, in 2 > the triangle inequality 
(3.8) for modular weight is satisfied if m is any of the 
moduli ae oe or 2741. 


Suppose first that WC Fy) = W(F4) and DEES = W( ar 


If also Es i F, < m, we have 
W_(F, O F)) A IS SB Fo) 
and thus by the triangle inequality for arithmetic weight (2.7), 


PESE) EME A A 


Ne theorem 1s proved for this case. Similarly, if 
E + F, zn» 


W (Fy @ F,) em WiC Rit Fem) 
so that again by (2.7) we have 
A © A A SW (E) a E 


This completes the proof for Wa CFn) = W(F,) and W(F,) = 
W( OF ,), and by symmetry for Ver) = WC OF, ) and De = 
W(F,). We note that we have not yet made use of our hypothesis 


eomeene form of m. 
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Suppose, momentarily, that the theorem holds when 


PE = W(F,) and eee = W(F,). Then the theorem also 


1) 
molds for Waly) = WC OF) and w = WC OF,), Since then, 


by property (3.5) 


MEE Neon enc er E W (OF) + W,( CF) 


WC Fy) + W (Fo). 


Hence, the theorem will be proved if we can prove it for the 
case where W Fy) = W(F,) and ie a = W(FJ), as we now proceed 
Bo do. 


If also Es + E> < m, we have 
W CF] O F,) E ES) 


and again we have, according to (2.7) 


AO Fo) 6 MICE J) OE) E 
ier * F, = m, we have W_(F, YH F2) = 0, so the theorem holds 
mervially. 
It remains to consider the case Es > F, > m. We now 
lee 


mipese our restriction on m and suppose first that m = 2 


By our hypotheses, 


EEn er F a 


1 > IZ 


NEO lows from Corollary 2.1 that the NAF of Fy web he given 
by the (n - 2)-tuple [boa b> -.+, by, Bol, where either 


(b b_) IS (1,005 In the former case, the term 


n+l?’ 
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+2" appears in the NAF of Fy “5 F3, and hence 


MB Po = Meere 1. 


Thus, 


AOR) A O SNIE ESO 


+ 1) 
Can be overbounded using the triangle inequality (2.7) as 
BEE) SHE FE) > O = WOR = Wa) 
Again using (2.7) we conclude 
E OE E USO + WCBS) 


Finally, we must consider the case when TE b_) = (r0); 


n+] 


moe, when +2 Poe ieee Ar FOr FF. - F,. Repeating 


1 


me Same steps as above, we find 


W(F, + F 


1 > 7 Zi) WCF, t F3) = Wi (7) t WU) 


meee also from (3.6) we have 
W (Fy OF,) = WCC GF,) © ( OF,)] = W[(m - F,) © (m -F,)] 


Hemme that 0 < 2m - Es A As tna 


E O) F,) = W(2m - F, -F,) < W(2m - F, - F,) 


Se ee eee) 


Ber rc We Made use of (2.5) in the last step. It follows that 
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again 
da © F,) = ee + "a 


so that the theorem is proved for the modulus m = ev 
BES lows from the norm properties (3.06) through (5-3) 
eaat for the moduli ea. oe and ae we can use modular 
weight to define a ee AO Z just as we used 
arithmetic weight to define a distance function for any set 
integers. 
Merinition 3.3 


me modular distance between the integers I, aides e210 ca? 


where m is one of the moduli oe ee or Di, is the modular 


weight of their difference and will be denoted D (I,, I,), 


De., 
Di E, I,) = O 17) (3.9) 


it follows immediately from (35.6) - (3.8) that the modular 
MS tance is a true metric for Z satisfying the three defining 


M perties for a metric. 


E D ys I E 


1? 


Dal. I3) > 0 with equality holding only for I = I, 
er 
D_ (I, I,) E Dip 1 > I) - Dis, 1,) (Ane 


For the special cases where the modulo m is 2" or a the 


mam modular distance of an AN code is the minimum of the 
modular distances between pairs of distinct code points. 
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Theorem 3.5 

For an An-code where m = AB is one of the moduli ee ee 
or 2 +1, the minimum modular distance and the minimum arithmetic 
AMS tance coincide. 

BOOT 


We know that, for Ny - N, = Nz 0 


D (AN}, AN,) = W. LAN - N2) ] = min [W(ANZ), W(AN,) J 


where Ny = B - N, MISS that the modular distance between 
distinct code points is always the arithmetic weight of some 

Bonzero code point. Hence, the minimum modular distance cannot 
ers smaller than es the minimum arithmetic weight of the non- 
zero code points. Conversely, if AN. is a code point of weight 


W then 


man ’ 
D090; AN.) = W(AN.) = W 


mMin 


so that the minimum modular distance Cannot exceed ee TE 


Bons that the minimum modular distance is exactly WE and 
hence by Theorem 3.1, exactly equal to the minimum arithmetic 
distance of the code. 

As a consequence, we will use the symbol De for Doth or 
these minimum distances. 

e damental theorem, analogous to Theorem 3.2 for 
arithmetic distance is introduced next: 


Theorem 3.6 


a oO andas > 0, an AN-code where m = AB is one 


n 


of the moduli ae O 2%+1 can correct all GUNS Tos 
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aer tc + 5 or less in its code points if and only 


if its minimum modular distance satisfies 


Di wert Fr Ss, 
min 


Suppose that at eee eo Sak snow thatthe decoder 
which decodes the result I into the nearest code point AN, i 
Mere 1s a code point AN, with Dee AN, ) < t, and announces 
@ecaetected error otherwise, performs the claimed correction and 
detection. For, suppose I = ANG)F, where AN is the correct 


result and WCF) eto en, DB, (1, DUO OA One 


meeempoint AN’, we have by the triangle inequality (3.12) that 


t 1 _ A BE 
D (I, AN’) > D (AN, AN’) - D (1, AN) > t + s 


por chat Ny = N and the error is corrected as claimed. Similarly, 


im t < UTE) eno ray other code point AN’, 
D CL, AN') > t 


Seethat no code point within distance t of I exists and a 
ma ected error will be announced as claimed. 
Now, suppose that UET AE there exist distinct 


eade points AN and AN' such that 
DCANP A NENE EEES 

fet 
ONE EONTR E'S E 
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where E' is the sum of the t highest-order terms in the NAF 
of AN - AN' and E is the sun of the remaining terms. (Note 


meat & or E' may not be an integer in Zn} Derine che ring 


Paeors F and F' as F= EE and F' Bar The same type 
er sarsument used in the latter part of the proof of Theorem 
me 1.e€., consideration of the NAF;s of E and E', shows that 
for any of the moduli 2"-1, 2", or 2"+1, WR) 5 
and Ber") ee cee UCel terOllOWs also trote property 


(3.2) of residues that 


AN' ©) AN = MES ean 


and hence that 
AN @ F = AN' GF! 


where F and F! are distinct ring errors with WCF) en eS aaa: 


BAP") ee ee isnt tie actual result Or some operation is 
I = ANOF = AN' @F'! 


Menta decoder to perform the claimed correction and detection 
e. inconsistently required to correct F' and also to 
euer Or detect F, and hence does not exist, which proves 


the theorem. 


Meee E RFECT AN SINGLE ERROR CORRECTING CODES 


nes p here of radius t about a point Tin a is defined 
Eene set of all integers J in Zn such that D_ (1,3) at 
ISO lume of such sphere is the number of integers in the 
Sphere. The volume of a sphere is also equal to the number 
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of integers F in Z_ with W_(F) < t, since J = 1 @F is in the 
sphere if and only if eee) eee Ne eve lume wor sa sphere is 
independent of its center 1. 

osea code with m = AB can correct all ring errors 
moe modular weight t or less. Then the spheres of radius t 
moout cach of its code points must be disjoint since otherwise 
there would be a possible result I at modular distance t or 
less) trom two code points so that one cf the two corresponding 
Hs ot modular weight t or less could not be corrected. But 
Since there must be B such disjoint spheres each with vE points 
and also there are only a total of m integers in Zo > OO WS 
Many AN-code capable of correcting t or fewer errors must 


satisfy the inequality 


BV, SS AB or 


pe < A WO) 


which is a bound corresponding precisely to the well known 
Semaine bound for parity check error correcting codes. An AN- 
Boge iS Said to be a perfect code or a sphere packed code if 
Mien pound in equation (3.13) holds with equality. Consider 

am AN-code with generator is a prime number A = p. Then the 
menor integers modulo A is a field G{p) under addition and 
multiplication modulo A. Before proceeding to the presenta- 
MOTO the next theorem, let's recall that in a field G(p} 


Ma 1s a primitive, then 
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a = 1 

at =a 

ao a@a 

ao = am 8a nen 
Det 


are all distinct elements of G(p). Also to simplify the 
MaC on in the proof to be given next, recall that in arith- 
metic modulo p, an integer is represented by R, (1). So 

p = En) = 0. Also, the additive inverse of a < p is 


-a = R_(-a) = p-1. 
a n a) = p 


Theorem 3.7 
Ms aaa da prine p and if 2 15 a primitive in 
fio) then: 

(a) A generates a code with De = 3 and B= 291 
Mere n =11/2) (A-1). 

So E > PES a primitive in G(p) 
but 2 is not, then A generates a code with same distance and 
Ee i. 

(c) The codes given by this theorem are perfect 
codes. 


Proof 


If A is prime, then 


AA O CS DA 


If 2 is a primitive then „(A-1)/2 # 1 and so 


Meme eT anion 21/2. -1. 


48 





As a consequence, the consecutive powers of 2 


BZ -2, . 
e 
Ns tines iia tact, they are all nonzero elements in 
HN oO ail possible weight F error have distinct syndromes, 


aby Theorem 3.3 part (a) of the theorem holds. If£© 2 is 


2... 29/2 


Pim tive, then 1, 2, 2 must be distinct since 


Mme squares are. Also none is equal to Q1, for if 22 = 01 
some j < (A-3)/2, then ya = l= ( o 2) for some 


5, which 15 impossible if © 2 is primitive. Again, 


69 (AHL) /2_ Cane 


Y y AI LE GCA-l)/2 is even, 


2) AI 1 hence 2147 1)/2 = - 1. Then, 2 is 
At ave and part a applies. If, on the other hand, © 2 is 
Seamiacive and 2 is not, then (A-1)/2 must be odd. Then, 
A 0, and the syndrome of the weight-1 errors l, 
mum 2 5/2 1, +2, G22, ..., G6 254°5)/? are 
enet. By Theorem 3.3 part b holds. 

Bonverseiy,,.Theorem 5.53 implies that if a or b holds, 
E he residues mod A must be congruent to + gh and A must 
be odd. Then 2, and therefore all the residues mod A, are 
Bemeauively prime to A, so that A must be prime. Then the 
Mesidues mod A form a field. The order of 2 is at least (A-1)/2 
Since the smaller powers of 2 have distinct residues. But the 
racer Of Z must divide A-1, so it must be either A-1 or (A-1)/2. 
[iewsame is true of @ 2. If the orders of both 2 and O 2 are 
(A-1)/2, then +2) is always an even power of a. This is im- 


meesiblec. therefore, either 2 or © 2 must have order A-1, that 
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ADE Pp rimitive. It remains to be shown that the code is 


perfect. 


The errors of weight 1 or less are just the integers 


0 or 2° and 
eee onen. 


So there are 2n + 1 integers, and the volume of radius 1 


sphere in Zm is 


_ 2 Del a 
= a a a len. 


Table I presents some codes given by Theorem 3.7. 
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Table I 


Some Perfect, Single Error Correcting AN Codes 


A B M BITS (N) BITS (AN) CLASS 
11 3 33 2 5 N 
13 5 65 3 6 N 
19 27 513 5 9 N 
23 89 2047 7 11 C 
29 565 16385 10 14 N 
37 7085 262145 13 18 N 
47 178481 8388607 18 23 c 
53 1266205 67108865 21 26 N 
59 9099507 536870913 24 29 N 
61 17602325 1073741825 25 30 N 
67 128207979 8589934593 27 33 N 
71 483939977 34359738367 29 35 c 
79 6958934353 549755813887 33 39 C 


NN 0. 52/0.94 16.08.07 


J> 
u 


code generator 

B = number of code points 

M= A x B = modulo of arithmetic performed by adder 

BITS (N) = number of bits required to represent the largest 
tnteger (B-1) 

BITS (AN) = number of bits required to represent the largest 


code point 
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NAC ETERNO CODES 


In this chapter we will study a very important class of 
mertnmetic codes: the cyclic AN codes. The cyclic nature 
of some AN codes was apparently first noticed by Mandelbaum in 
07 . 

M radix two form of a code point is of great interest, 
since it is the way code points are represented in digital 
Bomputers. By analogy with parity check error correcting 
codes we will thereafter refer to this representation as a 
code word. Since a code word is a representation of a code 
point we will use the two expressions as equivalents whenever 
1t seems appropriate. 

Definition 4.1 


Maewcychic shitt T(N) of a number N e Zn with radix-two 


IN 


Bern is La, +5 ay; ag] is another number N, € 


-]? ane m 


Beh 15 represented in radix-two form by the n-typle 
Pa > Anz» 95 A, Ay, a 11- 

M inition 4.2 

A cyclic AN code is an AN code which is closed under cyclic 
aen cing. Consider a cyclic AN code with a code point AN, € Zn 
Benz that its corresponding code word is of the form 111...111. 
This code is said to include an all one code word, and has 
A ao ecm henaistance petween tie all one code word and 
the 0 word is two. Such a code is therefore of little interest. 
But the all one code word necessarily corresponds to the largest 


code point. As a consequence, if we remove this code point from 
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the code the remaining set of numbers is still a cyclic AN code. 
In this chapter we will only consider those cyclic AN codes 
which do not include an all one code word. 

In Chapter II we have discussed the carry propagation in 
addition modulo m. We have verified then, that in addition 
modulo m = ae Gieco or opagates fromthe most significant 


Banary position into the least Significant binary position. 


Therefore, for modulo m = DU 


T(AN) = AN @ AN 


2 & AN (4.1) 


what implies that a AN code such that AB = 2”-1 is closed under 
@eelie Shifting and therefore cyclic. This observation is 
expressed in the following theoren. 

Theorem 4.1 

EMITAN code with B code points is cyclic if and only if A 
generates an ideal in Z? the ring of integers modulo M = AB = 
1. 

The sufficiency of the condition given by the theorem has 


e proved before by showing that 


T(AN) = 2QAN € 2 


Comversely, if a cyclic AN code includes the code word 


Xx FS a > Xp 2> » X, Xp = AK amet 
y= Koa eee ee p> Xs bs 1S also a code word 


aid hence a multiple of A. 





2 m = 
De 


7 = onL = 
ZAK (2 Sr, XxX -1 1 


= 
ll 
His 
1) M 
Ps 
buy 


Probe a multiple of A it is required that A divides 
2-1. Hence A generates an ideal in Za 

As a consequence of Theorem 4.1 we will assume that the 
modulus m is given by m = AB = ete throughout the remainder 
MOT discussion on cyclic AN codes. To represent integers 
modulo De, IN aos mare reguired. It is therefore 
iaa to think of the integer n as the code length. Again 
oy ine the terms from the theory of error correcting codes 
used in communications, we define the code rate R to be the 
tomo: the base two logarithm of the number of code points 
Ane base two logarithm of the total number of integers in 


oF 


the ring Zz er 


m’ 


R = (1log,B)/(log,m) = (log,B)/(log,A + log,B) (4.2) 


mie quantity log,A eea edite redundancy of the code, and 
aS an approximate measure of the number of extra binary portions 
mequired to represent the code points as opposed to those 
meauared to represent the original integers without coding. 
Fuppese now that a cyclic AN code has Den = Non = 1. 
Men, 21 must be a code word for some i, O£ifn, and hence 
must be a code point since pn css iitescol 1. It 
follows that A must be 1 and we have proved: 
Bheorem 4.2 
Berry cyclic AN code with A > 1 had Den AE OO 


With A = 3 are the least-redundant codes satisfying Theorem 4.2 


and have Den So OB» lL since W(A) = Z. Noting that 
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5 = aan divides 2”-1 if and enily if n is even, we have as an 
immediate consequence: 

Corollary 4.1 

For every even n greater than two, A = 3 generates a 
cyclic AN-code wıthB = DI code points and Da = 2. 
These codes can detect all single modular errors in their 
code points. 

We show next that there is a natural length n, determined 
entirely by A, for cyclic AN codes generated by A. We first 
remark that Theorem 4.1 shows that A must be odd if A generates 
er clic AN code. 

Romay positive odd integer A, the exponent of 2 modulo A, 
denoted e(A), is the least positive integer i such that A 
divides 22.1. From (3.2), we see that an equivalent statement 
is that iis the least positive integer such that RA (23) = 1. 
We show first that e(A) is always well-defined. Consider the 
Sequence of numbers Ra (29), E ER S a -oince A is odd. 
ii cannot divide 2) for any j, so that these numbers are all 
between 1 and A-1 inclusive. But then there must be specific 
integers j and k with l¢jck A such that Ry(2/) = R,(2%). By 


(3.2), this is equivalent to 
R, [2323 si) | = ao 


which implies that A divides 2 ne A is odd. This 
proves that e(A) is always well-defined for every positive odd 
Beer and also that e(4) <A -1. A continuation of this ar- 
gument shows further that the sequence of residues Re, 


joel, 2, 3, ..., 15 periodic with period e(A) and hence 
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that A divides 2”-1 if and only if n is a multiple of 
e(A). 

Mi enerates a cyclic AN code of length n, it follows 
from Theorem 4.1 that A divides 2”-1 and hence that n is a 


mictiple of e(A). If n > e(A), then ze (A) 


are na zcode point 
Since it is a multiple of A less than AB = 2%-1. Hence 
(assuming A > 1), the AN code has A = 2 since 1t has a 
Sedempoint OL arithmetic weight two. In view of the fact 
m except for A = 3, cyclic AN codes with D = 2 are of 
meee Interest, we will adopt the convention that, unless 
Benerwise Specified, the length n of the cyclic AN code 
generated by an odd positive integer A is to be taken as 
ee, the exponent of 2 modulo A. 


Theorem 4.5 


time cyclic AN code generated by an odd integer A (A > 1) 


has DE a andon y if either 
EI so ao 
(b) e(4) is even but A does not divide 22(4)1/2 41. 
Proof 


itesenly possible code points with arithmetic weight two 
are | and 21 Erin =< ei Aj. Since 1 <e(A), 
22 is not divisible by A and hence is not a code word. If 
al 1s a code point and hence divisible by A, then a 
Be is also divisible by A, so that 2i must be a 
ID le of e(A). Since i<e(A), this 1S impossible if e(A) 
is odd and requires e(A) = 21 if e(A) is even. Thus, ge(A)/2,4 


is the only possible code point with arithmetic weight two and 
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Goom aetial code point if and only if it is divisible 
Deas This proves the theorem. 

Example 

Take A = 21. We have then Ry (29) eer A l 
A >= 1, 2, 3, 4, 5, 6. Hence n = e(A) = 6 for the cyclic 
AN code generated by A = 21. We note that e(A) is even but 
A = 21 does not divide 22 (6)/2 +1 = 9, so that D_. > 3 by 
Miéorem 4.3. In fact, W(21) = w(2* t ol t 29) eo eso that 


mp 


In SAS sine leserror correctine code has B = Cua > 
ode points. 

e noa na poSI tilon to recognize that the codes given 
Me oren 3./ (b) are cyclic codes. In fact, they are the 
Mest, less redundant, cyclic AN codes with distance 3. The 


Becies listed in Table l ande rdent:ttiedewith.G are of this 


category. 


Pee NEGACYCLIC AN CODES 


NS ee ses cineteat enis point to open a brief paren- 
thesis to a comment on another class of codes related to that 
of cyclic AN codes, the so called negacyclic AN codes. We 
have shown that in addition modulo m = 2”-1 the carry generated 
is the highest binary position propagates to the lower position. 
Hemmave also related this observation with the cyclic character 
of AN codes with m = AB = 2*-1. Sliver Im addition modulo 
m = 2%+1 we can easily see that the carry generated at the 


highest binary position is subtracted from the lowest binary 


Merrcion. This fact gives the negacyclic character of AN 
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codes such that m = AB = = + |. The codes given by 


Theorem 3.7(a) are of this category. Also some of those 
codes with Den = 3 are listed in Table I, where marked 
with N. 


BE CALCULATION OF Dn POREC CEICTAN CODES 


In this section we will verify that the search for the 
code point with minimum arithmetic weight in a cyclic AN 
code can be limited to one sixth of its code points. First, 
notice from Corollary 2.1 that every nonzero I e Z a FOT 


Bon “es 
mw? I has an (n+l) position NAF [b, Desk by by] 


ama also that from Theorem 2.2. 


(jo Dao) Sew) for 0 < 31 < 2” (4.3) 
O a RS (4.4) 
De - (1,0) for ati 31 (4.5) 


7 


This suggests separting the set of integers in a into the 
corresponding three disjoint subsets characterized by the two 
Nest coefficients in their NAF's. For simplicity, we shall 
now adopt an interval notation for sets of integers and write 
(a,b) or (a,b] to denote the set of integers I such that 


a< I<borac< Is b, respectively, where a and b are any 


mea numbers. In particular, the sets of integers 
L3m = (0, 27/3) (4.6) 
a 2 ay (4.7) 
a 
Hemes Con 2 4 (4.8) 
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wee a ely the sets of integers I € Z n satisi ying (4.3), 
(4.4) and (4.5) respectively, and hence our desired partition 
of the nonzero integers in Zn 

Lemma 4.1 


For an integer l £ Zn 


En do if IeM3m and I is even, or if IeL3m. 
n 3 


W(m-I) otherwise. 

Proof 

Case A, leL3m. 

By (4.3) the NAF of I has two leading zeros so that 
w(2"-1) = W(I) +1. Thus, W(m-I) = W(2™-I-1) W(2™-I) - w(1) = 
Miele where the inequality follows from the triangular in- 
ale y for arithmetic distance (2.7) Since distance is just 
weight of the difference. Hence ES = W(I) as claimed. 

Mase B, IeU3m. 


Now (m-I) = 2 


-1 -I belongs to L3m so that MENE = W(m-T) 
by Case A above. 

Case C, leM3m. 

Now W(I) = W(2™-I). If I is odd, then 2”-1 is also odd 
and in M3m. Since 2"-I is Ole Uber setıng ome cannot increase 
its weight so we have W(2"-I-1)<W(2"-1) = W(I) and hence ner) = 
W(m-I). If I is even, then 2 °-1-I is odd and in M3m. The same 
argument then gives UE 2 == Lat) = W(K) but W(m- 1) = Ve so 
tT) = W(I). Thus, the theorem is proved. 


The subsequent discussion will be easier if we use the 


following Lemma, due to Hartman. 
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Lemma 4.2 


For an integer Tez 


Wi (1) = W_LT(1)]. 
Proof 
Case A, eo 
Ie leL3m, rentes Delsm or T(TJeM5m is even. In 
either case ees) | = WLT(I)] = W(t) = Ae If IeM3m and 


is even then PO = Me 227 = E) + 1 since the 


NAF of 2” - 21 ends in two zeros. Since Ze) om, w(2P =21I) 


W(21) -1. Hence by Lemma 4.1 W [T(1)] = OE 


ACI). 


suppose finally that IeM3m and I is odd. Then 
Wee = Wel) rand We2 -21) = WU) = 1. 


There are only two possible types of endings for the NAF of 
meme y are either 0, -1, followed by any number (including 
tomes Of repetitions of 0, 1; or 0, 0, 1, followed again by 
meemumber (including none) of repetitions of 0, 1. With 


the first type of ending we have: 


W(2"-I-1) = w(2"-1I) = W(I) - 1 and 


Hime Wi 2-21) = W(T) = 1. 
With the second type of ending we have: 


Hoa T i = WO- = W(1) and 


II A = Wer). 


Thus for either type of ending we have: 
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: n e n og _ 
ch) ze Tr ZW 22-27 -1) W [TD]. 
n-1 


(aise B, 1272 


fore = 2-1-1. 


Now W [T(1)] = W [m-T(1)] 


as ee] 


W [23]. 


But Wa) = vA D since J < 2*-1 and Dy Gace A above. 


Hence ee Cte = W (I) = WD) which completes the proof. 


Lemmas 4.1 and 4.2 give us the tools to derive the following 
theorem. 

Theorem 4.5 

In every cyclic AN code there is always at ee one code 


wemmt AN. in L3m with N, odd such that W(AN, ) = W 


1 


Proof 


i min” 

For any AN, SM > AN, = m- AN, is in Lóm and has the 
same modular weight. If AN, is in M3m and is odd, then - AN, 
is also in M3m and is even and has the same modular weight. 
mally, for AN, in M3m and even, AN, MSc ne cyclic shift (and 
hence by Lemma 4.2 has the same modular weight) as AN,/2, which 
is in L3m. Similarly, the even code points in L3m are some 
Mee@lac shift, and hence, have the same modular weight, of odd 
code points in L3m. Thus, there is always a nonzero odd code 
point in L3m with minimum modular weight. But by Lemma 4.1 
modular and arithmetic weights coincide in L3m. Hence, there 


is always a nonzero odd code point in Lim whose arithmetic 


weight is also the minimum modular weight in the code. But 
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ehr minimum Modular weight coincides with the minimum arith- 


metic weight a since the modular weight of any code point 


Je 
at most its arithmetic weight. 

Theorem 4.5 shows that the search for the minimum weight 
e nen aey lae AN code can be restricted to one sixth 
nne code points, namely those odd code points in Lim. Let 
us now take a deeper look into the properties of the code 
memes in Lim. We begin by noting that the NAF's of code 
Brass 1n L3m, according to (4.3), have n-place NAF's 
Me? +t by> by] Wivecwmeame evelically nonadjacent, that is 
bl] bg * 9. Thus if these NAF's are euere Sia Elena = cle 
mesult is always again an n-place NAF--although it may be the 
NAF of an integer not in L3m nor even in Zn sincera terke ome 
ME shifts, the NAF might have -I as its highest nonzero 
Seernicient:. 

Suppose now that leL3m. We define Ji, De en as anemkeger 
aeee n-place NAF is the ith cyclic shift of the NAF for I = Jo: 
J. /Menou Gestricted to be positive. We note that Se is 
tained from J; by ret doubling Ji and ehensszineeuleadın? 
@oerticient in the NAF for J; Veneen ero SUDtracting or 
adding m = 2-1 aseo mica sie ads Coefficient were +1 or -1. 


It follows that nO = Ri (233) amd with the aid.of (3.3) 


oe 
chat 


E 1 u i ; , 
RA (43) = R (2 Jo) = R (2 Des ien 129) 


Meeing next that J; has an n-place NAF and hence a magnitude 


less than m = 2 at follows from (4.9) that 
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J. Ron > 0 
aL 1 


R_(2°1) = (4.10) 


DPTO JS 0 
1 if 


Next, we observe that if P Oe by] is the NAF of 


i= J then Om II most digit in the n-place NAF 


OF = Je 
OT J;. But Seeordımestoma- Syschis leftmost digit will be 
+1 if and only if J; = R (27I) is in M3m and this leftmost 
digit will be +1 if and only if -J; = m - R (2I) is in M3m. 
Dow from (4.6) we see that for any Kin Zn K and m - K are 
Ser] both in M5m or neither is in M3m. It follows that 

are either both in Mim or neither is in M3m. It follows that 


b tenon erorii and only if RR lies in M3m. But 


i = 1 
the arithmetic weight of I, by Theorem 2.1 is just the number 
TON zero digits in the NAF of I, so that we have proved: 
Theorem 4.6 
cre im tepern iein Loam, its arithmetic weight W(I) is 
equal to the number of residues R, (271), ISS e Mate e 
mien = (27/3, 2”*1/3). 
eea O T COren 4.0 to the calculation of the 


merenmetic weight of a code point AN, in L3m is facilitated 


ip 


By noting that since m = AB, then 


i i i 
SR 02 AN,) = ARg (2 N,) Con 


so that R_(2°AN, ) lies in M3m if and only if AR, (2°N,) lies 
Sm, which in turn occurs if and only if Rp (2°N,) lies in 
the set of integers (B/5, 2B/3]. We have then as an immediate 


corollary of Theorem 4.6: 
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Corollary- 4.2 
Ke el C AN code and any code point AN, PAS, 
W(AN,) 15 equal to the number of residues REEN) WATER 


Wn the interval (B/3, 2B/3]. 


C. MANDELBAUM-BARROWS CODES 


The class of equidistant cyclic AN codes to be discussed 
MENS section is of great importance in the development of 
the theory of AN codes. Besides the fact that they were the 
Mist Systematically constructed class of AN codes with 


-. 


ÓN > 3, they were the first AN codes to be recognized as 
S lic. 

date ron tene” constitute an important step in the 
attempt to establish analogies between the theory of AN codes 
Gaumeebat OL che parity check error correcting codes. Those 
codes were discovered independently by Mandelbaum and Barrows. 
Mandelbaum was the only one who noticed their cyclic nature, 
Mete Barrows calculated their exact minimum distance. 

Letts define INT(r), where r is a positive real number 
as the integer part of r. The formulation of Mandelbaum- 
MECO Wws code is next made in the following theorem. 


Theorem 4.7 


feeb 1S any prime such that 2 1S primitive in GF(B), then 


A = m 1)/B generates an equidistant cyclic AN-code of 
length n = B - 1 and minimum distance De int (B+1)/3].: 
Proof 


E e e oO fOr which Z 1S primitive in GF(p), then 
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e(B) = e(p) = B - 1 


Let's choose the generator A and the code length such that 


a = (2°88) - 13/8 = (22712 - 1)/B and 
DEB Lo 
Ace 2 15 primitive in GF(p) = GF(B), the residues 
NO Dee a el 
are all the B - 1 nonzero elements of GF(B). It follows also 


meom (3.4) that for any N}, 0<N,<B, the residues Rp(2 N), 
are also all the B - 1 nonzero elements of 
AB) since they are just the modulo B product of the residues 
Bee former set by the fixed nonzero element Ny in (GRITE. 
memenen follows from Corollary 4.2 that all the code words in 


Mohave arithmetic weight int{[(B + 1)/3], and further by 


Theorem 4.5 that 


R O a G = A] 


In addition, we know from the proof of Theorem 4.5 that the 
modular weight of any nonzero code point coincides with the 
@rithmetic weight of a code point in L3m. Hence, all the 
mece Points in the entire code, except 0, have modular weight 
intL(B + 1)/3]. But also the modular distance between any 
Par of distinct code points is the modular weight of some 
nonzero code point. Thus, the modular distance between any 
Mare ot distinct code points is exactly int[(B + 1)/3], so 


Biewcode is equidistant. 
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Table Il gives a complete list of Mandelbaum-Barrow codes 


mich n less than 37. 





Table II 
Mandelbaum-Barrows codes (n<36) 

oe lee A Da Redundancy 

3 2 1 1 0 

5 4 5 2 Lae 

11 10 93 4 625 
13 iz ES 4 05 
19 18 USO 6 Los 

29 28 56392 10 2 
Er 56 ISS LOS eZ 507S 


Despite their great theoretical importance Mandelbaum- 
Barrow codes are highly redundant, since n binary digits are 
required to represent B = n-1 code points, and therefore, 


are not attractive for practical applications. 


PE NTERMEDIATE DISTANCE CYCLIC AN CODES 


We have discussed previously single error, perfect 
cyclic AN codes, given by Theorem 3.7, and the large distance 
equidistant Mandelbaum-Barrow codes. It would be of great 
theoretical importance and also of considerable practical 
interest if classes of cyclic AN codes with both intermediate 
distance and redundancy could be found. Unfortunately, there 
are not at present any systematically constructed classes of 
Cyclic AN codes falling in this category. Nevertheless, some 
specific codes have been discovered by trial and error 
techniques. Some of those codes are given in Table III. 
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TABLE III 


Some Intermediate Distance Codes 








oc am A Des Redundancy 
41 20 25,575 6 A 
113 28 2,375,535 5 NS 
151 15 A 4 7.8 
233 29 2,304,167 8 paleo 
241 24 107,415 4 16.1 
331 30 3,243,933 6 21.6 
337 pal 6,223 5 12.6 
601 25 55,831 7 15.8 
683 DE 6,141 4 12.6 
CO 3 29 486,737 7 18.9 
1801 25 18,631 5 UA 
2089 29 256,999 6 ESTO 
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EePANALOGYSBETWEEN AN CYCLIC CODES AND CYCLIC PARITY CHECK 
CODES 


o oa a e analog eS between Cyclic AN codes and 
MSIE parity codes, let's briefly recall the key ideas in 
fM@m@entneory of algebraic codes. 

Poi avOryMential ti Aje= £, + f.X + 2... + E or 

0 I Al 
meeree less than n with coefficients in a field F, one 


A oCiates the vector f = [f SE fgl in the vector 


n-1? °°? 
space FR. A Parity-check code 1s simply a set of such vectors 
meee form a subspace of E ten 1S Closed under 
Annon of vectors and scalar multiplication of vectors by 
meeweclements in F. The minimum Hamming distance de of such 
meee 1s defined as tne least number of positions in which 
Mmeemaistinct vectors, or code words, differ. The Hamming 
NEO a Vector —or code word-—1is the number of its non- 
nero compenents. lt is verified that the minimum distance dain 
in the code is always equal to the Hamming weight of the non- 
Memo vector of minimum Hamming weight in the code. The code 

eee elic if the cyclic shift of every code word is again a 
Be word. The cyclic shift of f results in a vector whose 
Seuresponding polynomial is obtained by multiplying f(X) by 

X modulo X? - 1. Let Cea montes. highest Co- 
efficient unity) polynomial of minimum degree among the non- 
zero f(X) in the code. Then, the necessary and sufficient 
Bem@amtion for the code to be cyclic is that g(X) divide 


E 


- ] and that every polynomial multiple of g(X) with degree 
less than n be a code word and that all code words are of this 
meme. It tollows that g(X) is unique in a cyclic code and is 
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called the generator polynomial of the code. The code is 
therefore an ideal in the ring of polynomials modulo Me = 
We recognize, therefore, that if we make 2 correspond to 
X, g(X) to A, Hamming weight to arithmetic weight, and so on 
the analogy between cyclic AN codes and cyclic parity heck 


aaor correcting codes is evident and very strong. 


fee tae BCH CONJECTURE FOR AN CODES 


The parallels between cyclic AN codes and cyclic parity 
Mex error correcting codes, discussed briefly in the 
previous section, led many theorists to believe that there 
must exist for cyclic AN codes a bound analogous to the Bose- 
Seamaniri-Hocquenghen (BCH) bound for cyclic parity check 
codes. 

We next address very briefly this question. 

BCH Bound 

ff 4 iS a primitive fe root of unity in the extension 
ed. E Of a field F and g{X) is a polynomial over F dividing 
x"-1 and having d-1 consecutive powers of @ among its roots, 
iene the minimum Hamming distance of the cyclic parity-check 
code of length n generated by g(X) is at least d. 

To pursue the possibility of a BCH type of bound for AN- 
eeaes we find some concepts from algebra and number theory 
Geoportal. The cyclotomic polynomial, Q. {X), 1s the polynomial 
having real coefficients whose roots are all and only the 
primitive a roots of unity among the complex numbers. The 


Mn St four Q; (X) are 
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li 
A 
t 
| 


0, (0) 


| 
vs 
+ 
| 


Q, (X) 
Qz (X) E 


e = x +] 


Km general Q; (X) generated by dividing eal D the product 
oa all us such that J<1i and j divides i, to eliminate the 
Meme primitive roots of -1 from the set of roots of the result- 
me polynomium. 

The integer = = Q, (2) is called the poh cyclotomic number. 
We note that 2”-1 has at least as many factors, As, as there 
meer tractors of n since at divides 2"-1 if and On bya it sa 
divides n. Except for A, = me Ss as A; when 1 # j. 

feomestablism a possible basis for a BCH bound for cyclic 
ANACO des we can factorize the generator A of a length n code 
as a product of integers A, where i divides n, then count 


: an 
tne number of consecutive powers of a = 2 / 


among the roots 
of the corresponding Q, (X). 

The factorization referred above is not unique in general. 
We must, therefore, find a rule to decide which are the "true" 
mieecors of A. 

A possible way to resolve this question is as follows: 

When there is more than one way to write A as the 

mroacuct of distinct A,'S, nana a constant not 
divisible by any other A'S where i divides n, then choose 
the way that yields the largest number of consecutive powers 
of & among the roots of the corresponding cyclotomic poly- 
nomials Q; (X) associated with the factors A; + Ia tnts es etting 
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we always consider A, = 1 to be one of the distinct factors 


Ot A; of A. In counting consecutive powers of a, ae Which is 
adroot Of Q (X), is considered to be adjacent to both Ad 
at re. oe Let's now state the following. 


BCH Conjecture 

A cyclic AN-code that has 2 consecutive powers of 
æ mong the roots of the cyclotomic polynomials, Q; (X) where 
me Gdivides n, that correspond to the factors A; in some 
factorization of A has a minimum arithmetic distance of at 
least (2+ 1)/2. The BCH conjecture above was proposed by 
Hartman in 1975, after having proved false a previous con- 
meesture introduced by Chien-Hong in 1970. Hartman's conjecture 
has been proved valid for some special cases, and also was 
Beam to hold for all cyclic AN codes with length n < 70, by 


means of extensive computer search. 
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Veiner CODES 


AI BASIC CONCEPTS 


Pempeinted out in Chapter 1, it is often desirable to 
have the coded words in an encoding system as consisting of 
Mmiemweriginal set of symbols N, concantenated with a separated 


set of check symbols C(N) 
N. = NeC(N) 


N will be referred to as the information integer, and C(N) as 
er heck integer. If a system like that described in the 
ean ious paragraph is used to check the proper operation of 
an adder, it is also desirable to make sure that the hardware 
Nivea 1n the check processing is independent of the basic 
adder itself. This will prevent the possibility that a single 
defective part might affect simultaneously the checker and the 
adder, resulting in an improperly corrected or even undetected 
Wor. 

moma consequence of the previous thoughts, the problem of 
defining an encoding system suitable to the generation of a 
Separate arithmetic code for addition can be stated as follows: 

(a) Define a rule to generate C(N) given N, and 


cama tan operation © such that 


A NS AN (5.1) 


2) 


me 





Fig. 5.1 represents a block diagram of an adder designed 
momlse a separate code for error Correction and/or detection. 

The reader is familiar with an error detecting code that 
meets the above characterization. The well know "nines out 
Maa for addition, that can be described as follows: 

IE resiente to perands Dy its decimal representa- 
Pron tollowed by its residue modulo Y so C(N) = Ro (N). 

A a O a aad ton on the decimal representa- 
momo: the operands (their information integer). Compute 
miemnresidue modulo 9 of the result (the check integer of the 
mesult). 

3. Perform modulo 9 addition (here the operation *) 
on the check integers of the operands. Compare with the result 
aa Eo] the check integer of the result. 

This simple illustration, taken from everybody's elementary 
oO experience, besides being a simple example of separate 
Bere nas the additional virtue of inducing in the reader's 
mind the idea that, unlike AN codes, separate codes can be 
momma that will be capable of checking both addition and 
multiplication. This would be a very significant advantage 
over AN codes, since many arithmetic units are desired to 
Beprorm multiplication as well as addition. A very good 
Brecht into the nature of separate codes is given by 
Theorem 4.1, due to Peterson. 

theorem 5.1 

tere are fewer check symbols than integers in the 
Dermissible range of integers, and if the check symbols C(N) 


Satisfy Equation 5.1, then C(N) must be the residue of N mod b 


ie 








CN 


1) 


AAN) EN Np) 


C(N,) 


A adder Usine Separate Code - Block Diagram. 
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in a coded form, where b is the number of distinct check 
symbols, and * is addition modulo b. 

Proof 

Let S denote the set of all integers N that have the 
Ane rcheck symbol as zero; that 1s, C(N) = C(0). The first 
ep in the proof is to show that S is an ideal in the ring 
MN tesers. By definition, zero is in S. Note that C(0) = 
meee) = C(0)*C(0), and therefore, C(0)*C(0)*... *C(0) = C(0), 
no matter how many factors appear on the left. Thus, if a is 


MN chen Na =.a + ... + a 1s in S, for 


C(Na) 


iia eae et al) MEA Gas) 


ll 
il 


DS LEO) CA 


alo, if a is in S, 


MA EUA = "CE (0)*C (<a) = C(a)?C(-a) 
= C€(a-a} = C(0) 
m@a@menerefore -a is in S also. Thus, S is an ideal. 


Néxt, note that C(N,) SN AAN iy ir Ny and N, are 


Me same residue class of S. This is shown as follows: 


C(N,) = C(N,)*C(N,-N,) 


If Ny and N3 are in the same residue class, N,-Ny Wein, o dnd 


C(N, > Ny) = C (0)... 


C(N,) = CCN, )*C (0) = C(N, +0) = C(N,) 


ehe other hand, if C(N = C(N,), then 


1) 
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C(N,-N,) = C(N,)*C(-Nj) = C(N,)*C(-N,) 


I 


C(N,-N,) = C(0); 


therefore, N,-N, is in the ideal S, and N 


Zr 2 


meme residue class of S. Note that this means that if two 


and N are in the 


different integers Ny and N, have the same check symbol, then 
the ideal S is nontrivial, for then C(0) = C(N,-No), and thus 
the ideal contains more than just the number zero. 

Bea know tliat Im a@ ring of integers any ideal is a 
Peeneipal ideal and thus contains all multiples of some 
Messer b. The residue classes are, therefore, residue 
em ees modulo b. Thus, there is a one-to-one correspondence 
between residue classes and check symbols. For every j, 
NI consider C(j) to be the check integer for the 
aaee Class containing j; that is, define C(j) = j. Then 

‘ 
meme ({1)"C{(j) = C(itj) = (1 + 2) mod b, and thus the checking 
operation 1s additon mod b. 

If there are as many check symbols as numbers, each number 
Meee distinct check symbol, and the checker is equivalent to 
w cate adder. Theorem 4.1 shows that separate codes, 
Menea according to (4.1) are necessarily residue codes. 
Since Rg (N1 XN, ) = Rp (Ny) X Rp (N,) we can conclude that residue 
aemeseaave the interesting property of being conserved through 


mualtiplication. 
P UC T RESIDUE CODES 
oane generalization of the ideas explored above is 


found in the theory of multiresidue codes, first introduced by 
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Dadayev. The multiresidue code in Z_ generated by the positive 
integers M,, M, «++ My erleben Ines dıvısor Of mis the set of 


Re) tuples of integers 


N. = [N, C UT C, (N) a Cy (N) ] 


Ber in Z. and where C. (N) = R; (N), 1 = 1, 2 ... k., So 
m T mi 


each code word is formed by one information integer N and k 
check integers C. (N). In this study we will assume that each 
of these integers is represented in its radix-2 form, as indi- 
Sed tor use in digital computers. Since each m ESA ES O Tr 


Seem it follows that 


NINA ee ASAS RR ESA) AE N 


th 


So the 1 check integer for N 


th 


1 N, ean De calculated as the 


modulo m; sum eof the i check integers for N, and N,. As 


1 2 

a result, modular arithmetic in Zn can be performed by k+l 
independent adders (or arithmetic units), the first, which 
Neill call the main processor, performing modulo m 
arithmetic on the information integers, while the other, 


which we will call checkers, performing modulo Mm; arithmetic 


on the corresponding check integer. 
IAN CODES AND MULTIRESIDUE CODES 
Consider A = LCM (m,, My... my) an re LCM (a Abiane] ) 


eS the least common multiple of a, b, ... j. 
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Lemma 4.1 
For any N in Zn the check integers C (N), daa Co (N) in 
the multiresidue code generated by M,, My, +... Mý uniquely 


determine and are also uniquely determined by the residue 


Ra (N) . 
OO E 
N = KA + Ry (N) 
but A = M,, M5, +... M, as an immediate consequence 
rm, (KA) USO Rin, ON) = Ra, CRA CN) J = C; (N). 


Now, suppose N} £ N, and Rn ND = Rn Ng) then Rip. NN) = 0 


fee, 2, ...., kK and (N) =N,) 1s divisible by Mm; tor .abEe 
But since A = LCM (m, Mys ++ my), N- -N3 is also divisible 
by A and then Ra (N1) = Ry (No). 
Now suppose that the result of some operation whose correct 
Ault is N is in fact 


N' = [NQ E, C (N), ee C (N) J 032.2) 


Bremse of a ring error F in the information digit N. It 
follows from Lemma 4.1 that the assumed correct check integers 
in N' suffice to determine Ra (N), which can then be subtracted 
modulo m from the possibly erroneous information integer N + F 


mi to give 


I = [NỌ Ry (N) ] le 


Meeeepon noting that N OR, (N) 1s divisible by A and thus of 


the form AN, emma ome 1) h< Ny < B= m/A, 
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I = AN, OF (575) 


Let's now define for a multiresidue code, its associated AN 
code as being the AN code with A = LCD (my > My e.. my). Then, 
emaon (4.2) proves that an error F occurred in the addition 
Sao multiresidue coded integers, can be corrected or detected 
if it can be corrected or detected in its associated AN code. 
In addition, the converse is also true, as we see, again using 
Lemma 4.1, from the fact that the same values of the check 
imeerzers would result from any of the B integers N having the 
same residue R, (N) determined by the check integers, so that 
the AN; in (5.3) might have been any of the code points in the 
associated AN-code. As a consequence, the following important 
and fundamental result is proved. 

Theorem 5.2 

If È and Tg are any disjoint subsets of 2,» then a multi- 
Needle code can correct any ring error F in ie appearing in 
information integer, or detect any ring error in In 
appearing in its information integer (assuming the check 
besers are error-free) if and only if the associated AN-code 
Simecorrect all ring errors in i and detect all ring errors in 
Ta in its code points Theorem 5.2 provides the justification 
to the emphasis given to AN codes, regardless of the fact 
that separate codes seem to be the most natural choice for 
Me practical applications. 

fie cyclic AN-codes again assume fundamental importance 
sense. in their case, m = 2%-1 and the main processor is then 


just an ordinary n-bit one's complement arithmetic unit. We 
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note that there is a freedom in choosing a multiresidue code 
from a given AN-code that can often be used to advantage in 
e ing the checkers. The only requirement is that the 


my be selected so that their least common multiple is A. 


Mi stance, 1f A = 315 = 3x5x21, we could select a uni- 
residue code with m, = EOI aso. setect a bDiresidue 
code with m, = 5 and m, = 21 or a biresidue code with m, = 15 
= a = l1 and m, = 63 = 2 n eer choices thé most 


sable since the two checkers could then be built as 4-bit 
Dat one's complement arithmetic units, respectively. 
Wms particular value for A generates a cyclic AN-code with 
Hemera m = 12, so that the main processor would be a 12-bit 
emo complement arithmetic unit. We will next show that 
there are useful biresidue codes derived from cyclic AN-codes 


Meee have one's complement checkers. 


Pee oLTIRESIDUE CODES DERIVED FROM CYCLIC AN-CODES 

When m, = Dr (ji SEO respondanme checker 
Sii a D DIt one's complement arithmetic unit as noted 
previously, but also the residues modulo b are easily formed, 
che check integers for N are simple to calculate. 
(Throughout this section, we shall often use the fact that 
Ray integer c > 1, ei divides on cen via Pele 
Pete integer 1 divides the positive integer j.) For, 
suppose m; = DoT and the multiresidue code is derived from 
Se clic AN-code so that m = 2"-1. Since Mm] divides m, then 


Beemvides n, so that the radix-2 form of any N in a may be 
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partitioned into n/b portions each with b Dits. If I; is the 


integer represented by the Ta Kon e t portion, then 


_ n-b 
MS ele FO a Lab 


meie follows then from (3.3) and (3.4) that 


ee = n C 


that is, the check digit C; (N) is the modulo 2°-1 sum of the 
mame cers PE I3, ee Em: Hence, the checker itself (which 
Ber D-bit one's complement arithmetic unit) can form the 
erek digit by adding the n/b integers represented by the con- 
Ave D-Dit portions of the radix-Z form of N as this 
mame 2 form is being read into the arithmetic unit of the main 
processor. 

We now gO On to consider some useful multiresidue codes 
@emaved trom cyclic codes each of whose m: is of- the form 
a tor some b. 

Pembining the results of Theorem 5.2 and Corollary 4.1, 
wer have immediately the following: 

Borollary 5.1 

For m = 2-1 and any even n, the uniresidue code generated 
by m, = en zu Sande reeesii ie sımele modular errors in its 
information integer. 

Pwemeicsce simple codes, the checker is simply a two-b1t 
comp lement arithmetic unit. If n is large, it is 


certainly reasonable to assume, as we have been doing, that 


the checker is much more reliable than the main processor. 
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We now proceed to establish a similar result for single- 
error-correction which is due to Rao. 

Theorem 5.3 

For any two integers a and Db, a > 1 and b > 1, the bi- 
residue code with m = DE al m, = aa and with m = 2"-1 
meme = LCM(a,b) can correct all single modular errors in its 
information integer. 

By Theorem 5.2 it suffices to show that A = LCM (my , m>) 
generates a cyclic AN-code of length n = LCM(a,b) having 


a 


D > 3. But A divides 2"-1 if and only if both m, = 2°-1 


min — 
and m, = De divide er lehnen occurs ifr andi only 
wR a.D) divides i. It follows that our choice of n 


satisfies n = e(A), the exponent of 2 modulo A. Now, by 


Theorem 3.3, D in SS e as even and A divides 


gn/2 + 1. But if n is even, at least one of a and b must be 
even, say a = 2a'. But a divides n and hence a' divides n/2, 


which implies that 2? - 1 divides 2"/* - 1 and further 


EN nz 


implies (for a' > 1) that - 1 does not divide 2 HI. 


f f 
fms, neither can m, = De We - 1) ee Hi a 


LCM(m, , m,) divide ¿n/2 SO ESE Der 


CO Ma. ls 
in 


The case where a' = 1, 1.e., where a = 2, is trivial. 

The single-error-correcting cyclic AN-codes derived from 
the biresidue codes of Theorem 5.3 are, of course, inferior, 
as AN-codes, to the perfect codes of Theorem 3.4. On the 
other hand, the form of the residues my and Mm, makes these 


codes the practical choice for implementation as biresidue 


codes. In fact, only uniresidue codes can be derived from 
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the codes of Theorem 3.7 since A is a prime p and the checker 
would have to do arithmetic in GF(p). 

Ekample s.l 

Choose a = 5 and b = 7 for the biresidue code in Theorem 
eer inen n = LCM(5, 7) = 35, so that the main processor is 
Ao bit one's complement arithmetic unit. The two checkers 
maemo bit and /-b1t one's complement arithmetic units, 
Nespectively. 

One important aspect of multiresidue codes should not be 
overlooked. The number of code words N in the multiresidue 
code is always given by m = AB regardless of the number of 
Some words B in the associated AN-code. Particularly for 
cyclic AN-codes where m = 2 - 1, we see that the number of 
code words in the multiresidue code depends only on the 
mime 1 Of the cyclic AN-code and not at all on its 


meommcancy Jog,A. A natural definition of the redundancy of 


the multiresidue code generated by MM, My, «++ M is as the 
quantity 
k k 
a 
ee log,m, = log,(1l  m,) (5.4) 
1=1 5 1=1 
Since A = LCM(n, , My, +s My) it follows that a multiresidue 


code always has at least as great redundancy as its associated 
AE ode, i.e., r > log,A, and that the redundancıes are equal 
ana only if the moduli m, are Po cat cl prime. 

We note also that r, as given by (5.4), is an approximate 
Bere of the number of bit positions required for the radix-2 


forms of the check integers in a multiresidue code. 
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FE Meccnnome onsTheorzem 5.5: should also be made. Suppose 
a divides b so that n = b and hence A = m = 2" - 1. The asso- 
ciated cyclic AN-code has only B = 1 code point and hence 
D_ in a e O Correct all errors in its code points. 
Ba orem 522, Ene Multiresidue code can correct all errors 
in its information integer if the check integers are error-free. 
This is not aS surprising as it may seem when one observes that 
Mm, = m, so Se comence isa tacita duplicate of 
waman processor! What this does point out is that our 
working assumption that the checkers are much more reliable 


Añana the Main processor is certainly unacceptable when some m. 
a 


coincides withm. 


E NDROMES IN MULTIRESIDUE CODES 


Suppose that 
= (I; Jı> J3, ee Ji) (5.5) 


memo (k+1)-tuple with I in Z n and J; m Z charerssogpossıply 
ji 
erroneous code word in a multiresidue code. We define the 


syndrome S(V) of V in the multiresidue code to be the k-tuple 


S(V) = R (1-34), TaN Ro A Mo 07) 
1 k 
Ms ce that if V is an actual code word N, then Ji = Ro (1), 
1 
so that from (3.2) we have 
SINE LO. ..., 0] (587) 


con versely, (5.7) holds only if V is a code word. 
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Nati na tictna tr conclusion does mot require our hypothesis 
Mime ror can occur Only in the information integer. 

Noe mos Cal Occur only im the information integer 
so that V has the form N' given in (5.2), we see that again 


Sah the aid of (3.2) that (5.0) gives 


A (FDI (5.8) 


e 


Pei o.8) together with Lemma 5.1 shows that S(N') uniquely 
determine, and in turn is uniquely determined by, Ri (E), MATE 
Mmewrecall from (5.5), is the ordinary syndrome S(A + F) for 
the result A + F in the associated AN-code. We have proved 
mie following: 

Lemma 5.2 

Mesmultiresidue code syndrome S(N') for a result N' = 
[N + E, cm), ARE Cy UN) ] uniquely determines, and in turn 
is uniquely determined by the syndrome S(A + F) of the 
associated AN-code. 

Dow, combining the results of Theorem 5.1, Lemma 5.2, 
paomineorem 3.3, we obtain the following: 

Theorem 5.4 

Let = and ta be any disjoint subsets of Des Then, a 
residue code can correct all ring errors in I lets 
information integer, and can detect all ring errors in Ty in 
its information integer (assuming the check integers are 


error-free), if and only if there is no error F, in ue that 


l 


mee ne same syndrome (5.8) as some other error F, in either 


in or Ta: 
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Naco rana to (5.5), the’checkers themselves 
can be used to calculate the syndrome S(V) = S(N'), since 


R (1-3,) = R (I) © J. fer Jj EZ, 


my my (5.9) 


k 


iis syndrome may then De used in an error correction and 
detection procedure for multiresidue codes entirely analogous 


enat suggested tor AN-codes. 
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VI. IMPLEMENTATION OF ARITHMETIC CODES 


We will in this chapter address briefly the question of 
implementation of arithmetic codes. The real problem in 
implementation is the decoder, that is, the device that 
checks the results for correctness, and that does the actual 
correction if a correctable error is found to have occurred. 

It is at the point interesting to note that the design 
of a decoder will depend upon the user choice of the sets 
Ue and To» respectively the set of correctable and detectable 
amors. It is to be noticed that Theorems3.2 and 3.6 do not 
er wermine > and s. 

For instance, for a code with minimum distance De = 6, 
decoders can be specified that will: 

a. Correct all single or double errors and detect 
triple errors (t = 2, s = 1). 

b. Correct all single errors and detect all double, 
Bene or quadruple errors (t = 1, s = 3), or yet 

De tectiali errors with Weight less than 6 (t = 0, 
s = 5). All these choices give 2t + s De 
Figure 6.1 a, b and c illustrates respectively the decoders 


characterized in a, b and c above. 
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t S 
(a) (b) 
a aa Pec odine RULesS tor a 6 


Any actual result in sphere S. is translated into 
Some point 1. Points not included in any S; are 
detected as errors. 


meee DECODER FOR AN AN-CODE 


The decoding algorithms for an AN-code has been briefly 
Aalmned in Chapter IV, and is next discussed in further 
detail. If the actual--possibly erroneous— result of an 
Seemacion is Y, the first step in the decodification process 
Bro calculate the syndrome S(Y). A syndrome S(Y) = 0 1s 
Mieempreted aS a correct result. 

If a nonzero syndrome results, the next step is to look 


Mn a table the correction C = - F, corresponding to S(Y). 
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Theorem 3.3 guarantees that there is a one to one correspondence 
between the syndrome of any correctable error and the error 


itself. The correct result is therefore 
NAO 


Meme 6.2 presents a flow chart of the above described algo- 
Brehm. Notice that steps 4, 5 and 7 are not required if only 
tection of errors is desired. 

We see immediately that only two of the steps in the 
algorithm involve some difficulty. 

a. The determination of the syndrome S(Y) = OS 
since this calculation requires the determination of the 
remainder of the division of Y by A, and it does not seem 
very smart to check an addition with an algorithm that 
Beguires a more involved operation such as division. This 
problem w111l be addressed in Section C. 

Oe oek Up operation to find the correction, given 
As y narome. This operation, even though conceptually trivial 
may require a very extensive table, when large or even moderate 
fmereamce codes are used and if a decoder with large error 
@emeneeting Capability is desired. Notice however, that this 
meses unnecessary for decoders that only make error detection, 
and further, that the size of the table is considerably reduced 
Many a small set of errors is to be corrected, as in the case 
Semele error correction. 

The look up operation also may result in considerable delays, 
but use of associative memories may be a way of eliminating 


such excessive delays. 
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CALCULATE 
S(Y) = RA 


BOOK UP 


eee (LY) 





Y IS AN 
ERRONEOUS RESUL 





FROCEED 


Fig. 6.2. Flow chart for decoding algorithm for AN-codes. 
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PADE CODER FOR RESIDUE CODES 


Deea eoa ea e decodes a multıresidue code 15 very 
Atar to that described in Section A. 
If N' is a possibly erroneous result of an addition, then 


mre syndrome S(N') 1s, according to (5.8) 
S(N') = [Ry (F), Ry (F) -+ Ry (FDI 


As pointed out in (5.9) the syndrome can be evaluated by the 
emeckers themselves, provided Ry. (I) SO some AS aL, 
Miér determination of S(N') o the determination of the 
remainder of a division of I by M; Lemma 5.2 assures the 
passib1lity of constructing a lock-up table that translates 
ergy) into the correction to be applied to N' to produce the 


@errect result. 
fee DETERMINATION OF Ry ON) 


mE nOon Con ider the problem of determining the residue 
of an arbitrary integer N, represented in its radix-2 form, 
modulo another integer M. 

Reme nave shown previously, this is an essential step in 
any algorithm intended to decode an arithmetic code. 

We will show that this determination can be accomplished 
Deans Of a modulo M multiply by 2 shift register, with 
Peek diagram is represented in Fig. 6.3. 


Fig. 6.3 gives a false impression about how complicated 


the circuit is, because it attempts to make a general, easy 


to understand schematic Hepigeseneactvon 0: the device. 
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ARAU ABEOCGR1 is just a {n+l} input, one output 
combinational logic network, and BLOCK 2 is just a few 
pieces of wire, correcting the output of BLOCK 1 (OUT 1) to 
the proper adder inputs to form the negative of M, modulo 
a, in such a way that the adder actually subtracts M from 
the content of the register whenever OUT 1 = 1. The opera- 
Snort the device is self explanatory. 

N is shifted into the register, most significant binary 
digit first. Whenever the contents of the register is 
eeater than M-1/2, or is equal to M-1/2 but the input is 1, 
the content of the register after next shift would be greater 
mmo, but less than 2M. If M is subtracted at shift time, 
then the content of the register will be conserved less than 
M, and Ry ON) will be stored in the register after N is 
completely shifted in. 

An example of such a circuit is given in Figure 6.4 which 
represents a modulo 5, multiply by 2 shift register, that 
mer Calculate Re (N), Pegardless the nilength of the radix-2 form 
SNE fo illustrate the operation of the circuit in Figure 
60m4; let's take N = 10110 = 2210: Table IV gives the 


successive states of the register as N is shifted in. 





eee A ee SES (ME 


| 
| 


EH 


OUT 1 
Q, DFF Q1 DFF e DFF 
D, Dy Do 
S 5 S7 So 
HALF FULL | HALE 
ADD ADD -r ADD 
1 CS 
a O TOT nn 7 
BLOCK 2 | 


oa lo Ss multiply by 2 shift register. 


TABLE IV 
e l e a a a e input | 
000 ve 


001 0 
010 1 
000 I 1 
0 
xX 


N å e O 


001 
010 


Operation of Modulo 5 Divided by 2 Shift Register 


uw + 0 
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ION SEUS TON 


Mime ctiesis const tutes a tutorial study on arithmetic 
codes. 

eee S appropriate at this point to emphasize the fact 
that the problem of designing an arithmetic code is essentially 
that of finding a generator A which generates an AN-code with 
m@meedesired error correcting and detecting capabilities for 
@da@ition in the ring of integers modulo B. This is evident 
for AN-codes. For residue codes it translates into finding 
an integer A = LCM (my > Mar sees My) which generates an AN- 
code which is capable of correcting all errors in Wey and of 
Meeeeting all errors in Ta? Be Pee ee e sets or 
correctable and detectable errors in the information integers 
of the residue code defined by M,, My, «++, My and the number 
Æ ode points. 

The theory discussed in the previous chapters provides 
some guidance and some tools to solve that problem. We have 
Matan ed in Chapter 4, that perfect, single error correcting 
P-codes, analogous to Hamming parity check error correcting 
codes are known. Also, large distance cyclic AN-codes have 
been discovered by Mandelbaum and Barrows. Unfortunately, 
moderate distance, systematically constructed AN-codes are 
not known. A proof of a BCH-like bound for AN-codes such as 
the Hartman conjecture outlined in Chapter IV would constitute 
ANA Or theoretical contribution to the field of arithmetic 


codes. 
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Cmeriommpnactiecal Side Of the matter we recognize that 
PMRetisiyceGircultny 1s required to decode arithmetic codes. 
The search for more efficient algorithms, applicable to 
particular Classes of codes, that could be easily implemented 
in hardware is an attractive and promising area for future 
research. The analogies between cyclic AN-codes and cyclic 
Poemeye check error correcting codes may suggest the possibility 
of decoding with shift registers. 

We have through this paper made the assumption of perfect 
e oding, Since our main concern was the structure of arith- 
Mete codes. In real life, this assumption is quite unrealis- 
eene evaluation of the improvement in reliability that 
can be achieved by using arithmetic codes under imperfect 
meeoaine 15 also an interesting subject for additional effort. 

imally, it 1S appropriate to mention that this thesis is 
wn ended to present original contributions. The material 
BE eussed here has been discussed by many authors, such as 


Heron, Massey, Garcia, Hartman, Avizienis and many others. 
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